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ABSTRACT 

An instruaent was developed and tested which would 
aeasure interaediate interaction behavior in snail-group 
connunication. The study was designed to uncover the several 
diaensions of such behavior and produce a reliable, valid neasure for 
each diaension that would yield data anenable to paranetric 
statistical analysis. Analysis of two experinents in snail-group 
discussion revealed six nain factors* orientation, tension, 
flexibility, relevance, interest, and verbosity. These factors were 
chosen for the Internediate Interaction Behavior Reasure (IIBR). 
Significance tests confirned the validity of these factors. The IIBR 
should be useful in aeasuring either M live M or videotaped interactive 
behavior. (JK) 
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THE DEVELOPMENT OF AN INSTRUMENT FOR 
MEASURING INTERMEDIATE INTERACTION BEHAVIOR IN SMALL GROUPS 



Jamus C. McCrrskey and David W. Wrtoht 
Illinois State University 



Although many writers have suggested that more research In communication 
should consider commun I cation as a process, relatively few studies have been 
reported that have actually measured communication behavior from a process 
orientation. This is particularly true In the area of small group communication.* 

A partial explanation for this shortcoming In small group research may be that 
small group researchers In the past have retied too extensively on Bales" <11 
Interaction process Analysis (IPA). 

IPA has several major limitations. Gouran (2) , for example, has pointed to 
two major weaknesses: First, Bales' categories are mutually exclusive, a charac- 

teristic of the system which prevents a contribution from being classified In 
more than one way, and which presumes uni dimensions 1 1 ty of Individual contributions. 
Second, the system yields data thaf cannot be subjected to normal parametric 
statistical analysts. 

Leathers (4) has recently reported a new rating-type Instrument which he 
has suggested as ", » » an alternate to product measurement by attempting to 
measure the Immediate effect of different /9jbes of contributions on groun 
communication’' (4, p. 267). Leathers' approach holds much more promise for 
measuring communication behavior from a process view than IPA, because It has the 
potential for overcoming both of the major weaknesses of the IPA system noted 
above* The Leathers instrument permits raters to respond on semantic dtfferentlal- 
type scales to Individual Interaction behaviors of communicators In a small group 
on nine "dimensions". 

The major problem with the Leathers Instrument Is that, although he was 
able to obtain fairly high reliability from hts raters, the "dimensions" of the 
Instrument were apparently subjectively determined. No data from factor analysts 
has been reported to support tho existence of these supposed "dimensions". 

The purpose of the present study was the development and testing of an 
Instrument for measuring Intermediate Interaction behavior In smelt group 
communication. It was susoected at the outset that such behaviors are multi- 
dimensional In nature* This study, therefore, was designed to uncover those 
dimensions and produce a reliable and valid measure for each dimension that would 
yield data amenable to parametric statistical analysts. 

Method 

Materials . A thirty minute discussion on the topic "What should the university 
do about parking In the campus area?" was videotaped. The discussants were five 
undergraduate students In their first course In smalt group communication at 
Illinois State University* Participation by the five discussants was spontaneous 
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and unrehearsed. The discussants v»jre a ^3 re tnat they were being videotaped, 
but reported that they did not feel that the vldoci taring interfered with their 
normal communication patterns. 

A thirty- item, seven-step semantic differential-type Instrument was developed. 
The Instrument included the nine items previously employed by Leathers (4). Two 
Items of a similar nature to each of the Leathers Items were Included. These 
were added to Increase the possibility that each of the Leathers Items, in 
company with the added Items, could generate an Independent factor from factor 
analysis, If Indeed such a dimension existed. Three additional Items of a 
general nature were added. The Items on the Instrument were as follows, the 
Leathers Items capitalized: 

wordy: short, INFLEXIBLE:FLEXIQLE, uncritical :crltfcal , obstruct We: constructive, 
SIGNAL: SYMBOL, fragmented:whole, task oriented: social ly-emotlonal ly oriented, 
IOEATIONALjPERSONAL, INVOLVED: WITHDRAWN, feeling response:thlnk1ng response, 
lnterested:apathetfc, log’-al :non-logfcal , tangential :goai-bound, bothered: 
cool , uncompromt s!ng:comprorr1 sing, complete incomplete, brief : lengthy, 
di5organlzed:organlzed, CLEAR :COMFUSED, unconcerned: concerned, harmful:heipfut, 
re I ated > unre I ated , DIGRESSIVE:CONCi$E, RELEVANT: IRRELEVANT, concrete: abstract, 
up tfght:calm, unchnngeable:changeabte, ATOMIZEDiUNIFIED, TEN$E:RELAXED, 

1 1 1-def 1 ned:wei i-deflneo. 

Evaluators . There were two phases to the current Investigation, the Initial 
phase and the replication. In the initial phase two groups of evaluators were 
employed. Each group was composed of thirteen students In their first under- 
graduate course In small group communication. In the replication twelve students 
In an advanced graduate seminar In smalt group comraun I cation were employed as 
evaluators. The evaluators received brief training In the use of the Instrument 
before being employed in the study. There was general discussion of the meaning 
of the terms used on the Instrument. A taped discussion, slml lar to the video- 
tape used In this study, was played so that the evaluators would have practice 
In use of the Instrument. Procedural and semantic problems were covered, as well 
as other administrative details. 

Procedures . Fifteen stimulus statements were randomly selected from the 
v 1 deotaped d 1 scuss 1 on for the Initial phase of the study. A table of random 
numbers and the tape-distance counter on the video recorder were employed In 
the selection. The evaluators viewed the videotape until It was stopped Immediately 
after a stimulus statement. Their attention was called to the stimulus statement 
by rewinding the videotape and replaying the statement. They were asked to 
complete the evaluation Instrument on the basis of the next participation following 
the stimulus statement (the response). 

Two minutes were allotted for the evaluators to complete the Instrument after 
each stimulus-response Induction. In every Instance the evaluators had ample time 
to oonplete the instrument. The total administration time for each group of 
evaluetors was approximately one hour. 

The same procedures were followed for both the Initial phase of the study 
and the replication, except that different stimulus statements were selected for 
the two phases. 
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Statistical Analysis 

The data obtained from the two phases of the study were analyzed separately. 

In each case the data were first submitted to principle components factor analysis 
and varlmax rotation. The cut-off criterion for rotation was an eigenvalue of 
1.0. ' An Item was considered loaded on a given factor If It had a rotated factor 
loading on that factor of at least .60 and had no rotated loading on another 
factor higher than .40. 

After the factor structure had been determined, the two Items with the 
highest and purest loadings on each of the factors (based on the above criteria) 
were selected and scored for each evaluator on each of his fifteen responses. 

The reliability of the evaluators' use of the instrument was examined by means 
of the analysis of variance procedure proposed by Hoyt and Guilford (3). 

Finally, the data were subjected to one-way analysis of variance with repeated 
measures, the fifteen stimulus-response evaluation points serving as the levels 
of the Independent variable. The data fgc each. factor were analyzed separately. 

With twenty-six evaluators each completing the instrument fifteen times, 
the "N” for the Initial phase of the study was 390. The "IT for the repllcatt' . 
was 180, twelve raters completing the Instrument fifteen times. 

Results 



Factor analysis Indlcatod the presence of six factors on the Instrument tn 
both the Initial phase of the study and !n the replication. These factors were 
labeled, on the basis of the content of the Items with the highest rotated 
loadings on the factors, as follows: Orientation, Tension, Flexibility, Relevance, 

Interest, and Verbosity. Table I reports the items selected for the Intermediate 
Interaction Behavior Measure (I ISM) and the rotated factor loadings for each 
(torn on each factor for both the Initial study and the replication. 

Analysis of variance re I lability estimates were computed separately for the 
twenty-six raters in the Initial phase of the study and for the twelve raters 
In the replication. The obtained reliability estimates for each factor composed 
of the two best Items on that factor are reported in Table II . The obtained 
reliability estimates ranged from .64 to .92. 

The factor analytic procedure Is designed to discover Independent dimensions 
present In an Instrument such as the one employed In this Investigation, tn 
theory at least, such dimensions should be uncorrelated. To the extent that 
they are correlated, thetr Independence must be questioned, and their potential 
usefulness Is somewhat reduced. In order to determine how Independent the factors 
obtained In this s*udy were, correlations among the scores on the various factors 
for each of the two phases of the study were computed. The results of this analysis 
are reported In Table III. WhC- factors I, 4, and 5 were significantly Inler- 
cor related, as were factors 2, 4, and 5, the maximum amount of variance on one 
factor predictable from another factor was only approximately thirty per cent. 

The contributions randomly selected for evaluation In this Investigation 
differed markedly as to type and quality. If the I IBM is to be presumed to have 
any validity as a measure of Intermediate Interaction behavior. It should reflect 
those differences. The repeated measures analyses of variance provided a direct 
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test of the hypothesis that the Intermediate interaction behaviors evaluated In 
this study differed on the six factors of the I IBM. The results of these analyses 
provided support for that hypothesis for all of the factors except Verbosity* 

With the exception of this factor, all of the analyses yielded F-ratlos that were 
statistically significant at the .01 level. The results on the Verbosity factor 
were clearly non-slgnlflcant (F < 1.0)* 

Discussion 

The first purpose of this Investigation was to discover the dimensions of 
Intermediate Interaction behavior in small group communication. Six dimensions 
were discovered In the initial Investigation and the same six dimensions were 
observed tn the replication. Because the Ss In the Initial Investigation were 
comparatively untrained In small group communication theory (only part way through 
their first course) while the Ss In the replication were highly trained (In their 
second graduate course). It Is reasonable to conclude that the observed dimensions 
are not the function of Instruction In small group communication theory. The 
I IBM, therefore, can be used by evaluators with either minimal or extensive know- 
ledge of small group communication theory with the expectation that the factor 
structure In the resulting data wilt not be affected by this variable. This Is 
particularly Important for the researcher who has few or no potential evaluators 
available who are knowledgeable In small group communication theory.. 

The second purpose of the present study was the development of a measuring 
Instrument for Intermediate Interaction behavior In small group communication that 
would be amenable to parametric statistical analysis* The semantic differential- 
approach to measurement has been general ly accepted by researchers as one which 
yields data that meets the assumption of Interval tty required for parametric 
statistical analysis; hence* this approach was selected. 

The resulting Instrument was found to have acceptable reliabilities on oach 
of the six factors measured. Since reliability In the use of this type of Instru- 
ment Is closely tied to the number of evaluators using the Instrument, the research- 
er who wishes to Improve his rellabl I tty of measurement may do so by Increasing 
the number of evaluators he employs. Since people need no special background to 
be selected as evaluators, and training of evaluators Is a brief and staple task, 
this Is a viable procedure* 

Validity Is always an Important question In the development of a measuring 
Instrument* In most cases In the field of communication, there Is no absolute 
criterion against which to compare a newly developed Instrument to establish Its 
validity, or lack of same. This Instance Is no exception. One Important check 
on the validity of a measure Is whether the measure can detect differences we 
know or believe exist. The (IBM was ab^e to detect differences that were believed 
to exist among the fifteen Intermediate Interaction behaviors employed In this 
study* Such differences were observed on five of the six dimensions of the Instru- 
ment. The single exception was the Verbosity dimension* Since this dimension Is 
primarily concerned with the length of a contribution. If all of the contribu- 
tions were of about the same length, no difference In Verbosity sooros should be 
expected* Such was the case In -the present study* 

From the results of this study, therefore, we may conclude that there are 
six observable dimensions of Intermediate Interaction behavior tn small group 
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communication and that the I IBM Is capable of reliably measuring those dimensions 
with some presumption of validity. The I IBM permits the researcher to examine 
the effects of any number of communication variables In small group communication 
from a process orientation In a way that yields data that can be analyzed by means 
of any appropriate parametric statist I cel procedure. 

Altltough the I ISM was developed primarily as a measure of Intermediate Inter- 
action behavior In Intragroup communication. It should be equally applicable to 
measurement of such behavior In any Interpersonal communication setting. One 
limitation, however, must be stressed. The (IBM was developed In a setting where 
evaluators could respond to both verbal and nonverbal stimuli provided by communi- 
cators. As such, the instrument should be useful for measuring Intermediate Inter- 
action behaviors either "llvtf* or by means of videotape. The use of audiotape 
would remove many of the nonverbal stimuli and manuscrlptlng would remove even 
more. Henco, application of the I IBM In these circumstances must be done with 
ful ■ awareness that some of the dimensions (particularly Tension and Interest) 
may not bo as fully measured as they would be If the live or videotape approach 
were employed. 
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Table I 



Intermediate Interaction Behavior Measure 



Item 


Evaluation 

Group 






Rotated Factor Loadings** 










Orientation 


Tension 


Ftexlbl Hty 


Relevance 


Interest 


Verbosity 


Task Oriented: 


Initial 


.81* 


.06 


.01 


.31 


.17 


.00 


Social ly~Emotlonally 
Oriented 


Replication 


.61* 


.00 


.06 


.39 


.22 


.11 


Ideational :Personal 


1 


.81* 


.03 


.10 


.19 


.01 


.17 




R 


.78* 


.01 


.05 


.22 


.17 


.16 


Bothered: Cool 


1 


.08 


.75* 


.09 


.16 


.29 


.20 




R 


.04 


.87* 


.04 


.20 


.04 


.02 


Tense: Relaxed 


1 


.02 


.75* 


.18 


.24 


.18 


.14 




R 


.09 


.82* 


.09 


.21 


.05 


.23 


Flexible: inflexible 


I 


.02 


.06 


.75* 


.07 


.21 


.15 




R 


.22 


.00 


.79* 


.02 


.01 


.09 


Unchangeable .-Changeable 


1 


.07 


.12 


.67* 


.17 


.IS 


.13 




R 


.05 


.11 


.87* 


.04 


.00 


.09 


Relevant: 1 rre levant 


1 


.26 


.07 


.11 


.73* 


.34 


.03 




R 


.16 


.06 


.08 


.84* 


.25 


.09 


Related: Unrelated 


1 


.14 


.01 


.12 


.76* 


.39 


.07 




R 


.26 


.15 


.05 


.76* 


.33 


.11 


1 interested :Apathet I c 


1 


.15 


.20 


.02 


.17 


.73* 


.07 




R 


.26 


.20 


.05 


.30 


.73* 


.06 


Involved: With drawn 


1 


.08 


.20 


.02 


.24 


.76* 


.04 




R 


.34 


.02 


*.03 


.26 


.71* 


.00 


Wordy: Short 


1 


.04 


.19 


.04 


.23 


.01 


.83* 




R 


.10 


.13 


.01 * 


.00 


.09 


.91* 


Brief : Lengthy 


1 


.04 


.20 


.03 


.20 


.07 


.88* 


R 


.15 


.18 


.02 ■ 


.03 


.04 


.09* 



* Highest loading 

©*"* Rounded to two places, sign Ignored. 
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Table II 



Evaluator Reliability Estimates 



Group 



Factor 



Orientation 


Tension 


Flexibility 


Relevance 


Interest 


Verbosity 


Initial <n»26> .92 


.66 


64 


.71 


.86 


.78 


Replication (n»!2) .88 


.87 


.69 


.74 


.68 


.74 



Table III 



Interfactor Correlation Matrix 



Group 


Factor 






Factor 










1 


2 


3 


4 


5 


Initial 














(n-390) 


2 


-.16 












3 


-.03 


.08 










4 


.56* 


-.34* 


-.09 








5 


.52* 


-.25* 


.01 


.58* 






6 


-.06 


-.07 


-.05 


-.04 


.06 


Rapt (cation 














(n*!80) 


2 


-.14 












3 


-.06 


.09 










4 


.46* 


-.31* 


-.05 








5 


.29* 


-.41* 


-.02 


.50* 






6 


-.01 


-.02 


.02 


<N 

0 
• 

1 


.05 



* Correlation significant at .05 level. 
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